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Abstract 

We study the problem of entropy increase of the Bernoulli-shift map with- 
out recourse to the concept of trajectory and we discuss whether, and under 
which conditions if it does, the distribution density entropy coincides with the 

Kolmogorov-Sinai entropy, namely, with the trajectory entropy. 
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I. INTRODUCTION 



The problem of establishing a connection between the Kolmogorov-Sinai (KS) entropy 
|l|J^ and the conventional entropy expressed in terms of probability density is an interesting 
problem that is attracting some attention in literature 0,0. Early work on this subject 
goes back to the discussion of Goldstein and Penrose These authors, almost twenty 
years ago, established a connection between the KS entropy and a coarse-grained version 
of the distribution density entropy. The work of Ref. is based on a formal and rigorous 
mathematical treatment which for this reason might have eluded the attention of physicists 
working on this subject Thus we restate the problem using intuitive arguments which 

also make it possible for us to account for the more recent literature on the subject. In fact, 
our heuristic treatment will allow us to relate the results of the more recent work of Latora 
and Baranger to the earlier work of Zurek and Paz 0. 

In addition to revisiting the problem of how to make the KS entropy emerge from a 
nonequilibrium dynamic picture 0, we shall touch also the intriguing problem of whether 
a thermodynamic perspective has to rest on the adoption of trajectories, as implied by the 
concept itself of KS entropy, or on the use of probability densities, advocated with strong 
arguments by Petrosky and Prigogine f^J^. It is convenient to stress that the KS entropy 
is a property of a single trajectory. The phase space is divided into cells, each cell 
being assigned a given label Ur- Then we define a sequence of symbols by means of a single 
trajectory: The sequence is determined assigning to any time step the label of the cell where 
the trajectory lies at that time step. The trajectory is supposed to be large enough as to 
yield reliable values for the probabilities determined through the numerical frequencies. This 
means that we fix a window of size A^, and we move this window along the sequence. For 
any window position a string of symbols uqjUJi, . . . un-i is determined. Moving the window 
of fixed size along the infinite sequence generated by the trajectory we have to evaluate 
how many times the same string of symbols appears, thereby leading us to determine the 
probability p{uJo,Ui, . . .cujv-i)- The KS entropy is then defined by 
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hKs = lim H{N)/N, (1) 

N—^co 

where H{N) is the conventional Shannon entropy of the window of size defined by 

H{N) = p{uJo,uJi, . . .ujN^i)MPi^o,^i, ■ ■ -^N-i)]- (2) 

It is evident therefore that the KS entropy rests on trajectories, and, more specifically, it 
implies the adoption of only one trajectory of virtually infinite length. The KS entropy is 
very attractive because its value turns out to be independent of the repartition into cells 
of the phase space, due to the crucial role of the so called generating partitions [Q. In the 
specific case where a natural invariant distribution exists, it is shown that 

hKS = Y1 J C?Xpeg(x)Ai(x) (3) 

i 

with Aj(x) > O.Note that x denotes the coordinate of a multidimensional phase space, 
Peg(x) is the natural invariant distribution and Xi{x) is a local Lyapounov coefficient, with 
i = l,d, d being the dimension of the system under study. From Eq.(|^) we see that, as 
earlier pointed out, the KS entropy is independent of the repartition into cells. The original 
definition of Eq.(|l]), with thought of as time, means that the KS entropy, as a property 
of a single trajectory, is the rate of entropy increase per unit of time. However, since the 
single trajectory under examination is infinitely long, and explores in time all the phase 
space available, the KS entropy can also be expressed in the form of an average over the 
equilibrium distribution density, without any prejudice for the single trajectory nature of 
this "thermodynamic" property. 

According to Petrosky and Prigogine on the contrary, the connection between 

dynamics and thermodynamics implies the use of the Liouville equation 

d 

—pix,t) = -tLp{x,t), (4) 

where L denotes both the classical and the quantum Liouville operator, and p(x, t) is the 
nonequilibrium distribution density. The reason for this choice is that the analysis of the 
Liouville operator, through the "rigged Hilbert" space, allows the appearance of complex 
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eigenvalues which correspond to irreversibihty, and to the collapse of trajectories as well. 
This is the reason why distribution densities are judged to be more fundamental than tra- 
jectories. 

In this paper we limit our analysis to the special case where dynamics are generated by 
maps rather than by Hamiltonians. We do not address the difficult issue of discussing the 
thermodynamic limit N ^ oo which is the subject of very interesting recent discussions 
Il7|jl0(|, and where, according to Lebowitz |jlO|, ergodicity and mixing are neither necessary 



nor sufficient to guarantee the connection between dynamics and thermodynamics. We 
consider the case of low-dimension chaos, where probability emerges as a consequence of 
sensitivity to initial conditions 0. Even in this case, however, according to the perspective 
estabhshed by Petrosky and Prigogine , probability densities are more fundamental than 
trajectories. The readers interested in knowing more about this perspective, entirely based 



on probability density, should consult the illuminating work of Driebe [|TT|]. In this case the 
counterpart of Eq. (|) becomes 

p(x,t + l) = Ap(x,t), (5) 

where A is referred to as Frobenius-Perron operator. Of course, the operator L of Eq.(^ 
has to be identified with i{A — 1). 

According to the traditional wisdom, the Frobenius-Perron operator is expected to make 
the distribution densities evolve in the same way as that resulting from the time evolution 
of a set of trajectories with initial conditions determined by the initial distribution density 



ll|:The known cases of discrepancy between the two pictures are judged to be more apparent 



than real [|T2|. Nevertheless, even in the case of invertible maps, the birth of irreversibility 
can be studied using the same perspective as that adopted for Hamiltonian systems, with 
Eq.(^ replaced by Eq.(^), and so using again probability densities rather than trajectories. 

However, we attempt at digging out the KS entropy from Eq.(|^), and this purpose forces 
us to formulate a conjecture on how to relate entropy to p(x, t). A plausible choice seems 
to be 



S{t) = - [ p{yi,t)ln[p{yi,t)]dx. (6) 

We share the view of Goldstein and Penrose ^ who consider the KS entropy to be a 
nonequihbrium entropy. In other words, we may hope to derive the KS entropy from the 
time derivative of S(t) of Eq.(^. As Goldstein and Penrose do 0, to realize that purpose we 
have to address a delicate problem: In the case of invertible maps, S(t) is time independent 
TB[ , thereby implying a vanishing KS entropy. Yet, the baker's transformation, which is a 
well known example of invertible map, thereby yielding a time independent S{t), is shown 



IJI to yield a KS entropy equal to ln2, a fact suggesting a steady condition of entropy 
increase. We plan to discuss all this with the joint use of heuristic arguments and of the 
rigorous theoretical tools of Ref. |jTl[ . 

The present paper uses as a paradygm of invertible map the two-dimensional baker's 
transformation, depending on two coordinates, x and y, the former corresponding to dilata- 
tion and the latter to contraction. Using this prototype for invertible dynamics, we aim at 
proving that the adoption of the distribution density in the case of invertible chaotic maps 
would lead to an increasing process of fragmentation, depending not only, as the KS entropy 
does, on the positive Lyapounov coefficient, but also on the negative one. The adoption of a 
coarse graining has the effect of quenching the action of the negative Lyapunov coefficient, 
thereby allowing the KS entropy to show up. Then, to go beyond these heuristic arguments 
we make a trace on the variable y, namely, on the process responsible for contraction, and 
we focus our attention on the contracted dynamics. This is equivalent to that produced by 
the Bernoulli shift map. Here room is only left for dilatation and the problem can be solved 
with a rigorous mathematical method, without using trajectories. 

The outline of the paper is as follows. In Section II we shall illustrate our heuristic 
picture. In Section III we shall address the problem by means of a rigorous treatment 



resting on the theoretical tools provided by Driebe [11|. In Section IV we shall draw some 
conclusions. Some delicate mathematical problems behind the theoretical calculations of 
Section III are detailed in Appendix. 
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II. HEURISTIC ARGUMENTS 



Note that the cases studied by Latora and Baranger are two-dimensional, and our 
discussion here refers to a two-dimensional case, too. We have in mind the backer's trans- 
formation and X = {x, y). We denote by W{t) the number of cells occupied at a given time 
t. Note that W{0) < Wmax, where the symbol Wmax denotes the total number of cells into 
which we have divided the phase space X. Our heuristic approach is based on the following 
assumptions. 

(i) At the initial time only W{0) cells are occupied. 

(ii) At all times the trajectories are equally distributed over the set of occupied cells. 
This means 

S{t) = lnW{t). (7) 

(iii) We denote by A the positive Lyapounov coefficient, and we set 

W{t) = W{0)exp{Xt). (8) 



All these three assumptions have been borrowed from the recent work of Ref. [T^. The 
joint use of all them yields 

S{t) = Xt-lnW{0), (9) 

which corresponds to the Kolmogorov thermodynamical regime. Note that the positive 
Lyapounov coefficient in the case of the baker's transformation is shown to be: 



A = ln2. (10) 

Note also that according to the arguments of Section 1, the connection with the KS entropy 
is established through the time derivative of S(t). Thus, we conclude that 

dS 

_ = X = ln2 = hKs, (11) 

which corresponds to deriving the KS entropy from the distribution density picture. 
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This Kolmogorov regime is not infinitely extended. It has an upper bound, given by 
the fact that when equihbrium is reached, even in the merely sense of a coarse-grained 
equilibrium, then the entropy stops increasing. An estimate of this time is obviously given 
by the solution of the following equation 

InWmax = At - lnW{0), (12) 

which yields the following saturation time 

*. = iM^). (13) 

Furthermore a lower bound of validity exists, which will be easily estimated with very 
simple arguments. If the initial distribution includes a large number of cells and the size of 
this distribution along the coordinate y is L, and the size of the cells is e with e < L,, then 
it is evident that, in spite of the coarse graining the total number of cells occupied remains 
the same for a while. This time is easily estimated using the equation 

Lexp{-Xt) = e, (14) 

which in fact defines the time at which the distribution volume, and consequently,the system 
entropy starts increasing. This time is denoted by the symbol to and reads 

to^\ln{l). (15) 

Wc denote by U {t) the volume of the distribution density at time t and by V the volume 
of the phase space, thereby implying that U {t) < V. We note that 

w(o) ~ c7(o) ' ^ ^ 

where V is the total volume of the phase space and U{0) is the initial volume of the distri- 
bution density. Thus the Kolmogorov regime shows up in the following time interval 



t. = -(„^-J<t<t.= -/„^^j. (17) 



The time duration of the regime of vahdity of the Kolmogorov regime can be made infinitely 
extended by making the cell size infinitely small. This means that the conflict between the 
KS entropy prescription and the time independence of S{t) can be bypassed by focusing our 
attention on the intermediate region, whose time duration tends to infinity with e ^ 0. We 
note that a choice can be made such that V/U{0) = (L/e)^, with % > 1. This means the 
time duration of the Kolmogorov regime can be made x times larger than the time duration 
of the transition regime. For e — > both time durations become infinite, thereby showing 
that a Kolmogorov regime of infinite time duration can be obtained at the price, however, 
of waiting an infinitely long time for the entropy to increase. The infinite waiting time 



before the regime of entropy increase fits the observation [lT3| , p!2| that the Gibbs entropy of 
an invertible map is constant. The linear entropy increase showing up "after this infinite 
waiting time" allows the emergence of the KS entropy from within the probability density 
perspective. 

This kind of coarse graining might be criticized as corresponding to arbitrary choices of 
the observer. It is interesting to remark that there exists another interesting form of coarse 
graining, produced by weak stochastic forces. Both in the case where this stochastic forces 
mimic the interaction with the environment P[ or in the case where it happens to be an 



expression of spontaneous fluctuations [|1^] this kind of coarse graining can be regarded as 
being produced by nature. Here we limit ourselves to remarking that according to Zurek 
and Paz these stochastic forces contribute a fluctuation-dissipation process mimicking 
the interaction between the system of interest and the environment. These authors studied 
the inverted stochastic oscillator 

(18) 

where the friction 7 and the stochastic force f{t) are related to one another by the standard 
fluctuation-dissipation relation 

u T 

< ffit) >= 27 < 6{t) ^ 2DS{t). (19) 
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It is interesting to remark that the proper formulation of the second principle implies that 
the entropy of a system can only increase or remain constant under the condition of no 
energy exchange between the system and its environment. In the case of Eq.(|19|) the energy 
exchange between system and environment is negligible for any observation made in the 
time scale 

t « 1/7. (20) 

To ensure that the system entropy increase to take place with no energy exchange between 
system and its environment Zurek and Paz [3] set the condition of Eg . (^Of) and this, in turn, 
allows them to neglect the friction term in Eg. (p!8D . Then, these authors adopted the modes 

dx , . 
u = — + \x (21) 

and 

. . - + Ax. (22) 

which make it possible for them to split Eg.(|TBp into 

^ = Xu{t) + fit) (23) 

and 

^ = -Xw{t) + m. (24) 

Let us imagine the initial distribution density as a rectangle of size Aw{0) along the 
direction w and A-u(O) along the direction u. We keep denoting by U{t) the distribution 
volume at a given time t. Thus the volume of the initial distribution is 

f/(0) = Au{0)Aw{0). (25) 

In the absence of the stochastic force f{t), Egs.(P3D and Egs.(PB|) result in an exponential 
increase and an exponential decrease, with the same rate A, respectively. Consequently, the 
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Liouville theorem U{t) = U{0) is fulfiled. In the presence of stochastic force, we work as 
follows. In the former equation, with u increasing beyond any limit, the weak stochastic 
force f{t) can be neglected. This is not the case with the latter equation. In fact, w is a 
contracting variable in the absence of the stochastic force. In the presence of the stochastic 
force the minimum size of the distribution along w is given by 



(26) 



This minimum size is reached in a time determined by the solution of the following equation 



Aw(0)exp(-At) = {D/\) 



1/2 



(27) 



yielding 



to 



A \D 



1/2 



Aw{0). 



(28) 



Due to the fact that deterministic chaos is simulated by Zurek and Paz by means of an 
inverted parabola, these authors did not consider the entropy saturation effects. However, 
it is straigthforward to evaluate the saturation effect with heuristic arguments concerning 
the case where the total volume of the phase space has the finite value V. From the time 
t = t£, on, the distribution volume U{t) increases exponentially in time with the following 
expression 



U{t) = Aw{0)Au{0)exp{Xt) = {D / \f/^ Au{tD)exp{\t). 



(29) 



Thus, the saturation time is now given by 



ts = -In 



V 



_Am(0)Am;(0) 
Using Eq.(E3) we can write this saturation time as 



(30) 



ts = jln 



V 



U{0) 



(31) 



which coincides with Eqs.(|T^ and (|r 
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In conclusion, it seems that the emergence of a Kolmogorov regime is made possible 
by the existence of a form of coarse graining, and that it is independent of whether the 
coarse graining is realized by the division into cells or by a weak stochastic force. This 
property seems to make less important the discussion of whether the stochastic force is 
of environmental origin or rests on some kind of extension of the current physical laws. 
However, we have to point out that the situation significantly changes, if we move from a 
strongly to a weakly chaotic classical system. As a relevant example, let us refer ourselves 
to the work of Ref. [|l^]. The authors of this work study the asymptotic time limit of a 
diffusion process generated by using an intermittent map as a dynamic generator of diffusion. 
If these dynamics are perturbed by a white noise, a transition is provoked, at long times, 
from anomalous to normal diffusion. When the only source of random behavior is given by 
the sporadic randomness of the intermittent map |18|, the long-time limit is characterized 
by Levy statistics, a physical condition in a striking conflict with the condition of Gaussian 



statistics produced by the action of fluctuations IjT^. Here we limit our attention to the 
case of strong chaos where the two distinct sources of coarse graining produce equivalent 
effects. It might be of some interest for the reader to compare the coarse-graining approach 



of this section to the more formal method recently adopted by Fox to deal with the 
same problem. 

It is interesting to stress that to make the regime of validity of the Kolmogorov regime as 
extended as possible we must make the ratio V/U{0) as large as possible (virtually infinite). 
This means that we have to choose an initial distribution density so sharp as to become 
apparently equivalent to a single trajectory. This seems to be an attractive way of explaining 
why in this condition the KS entropy is recovered, since, as stressed in Section I, the KS 
entropy is a single trajectory property. However, in accordance with the authors of Refs. 
PJ^JTl[] we must admit that there exists a deep difference between a trajectory and a very 
sharp distribution. The latter is stable and robust, while the former is not. In Section HI 
we shall show that the rigorous derivation of the Kolmogorov regime requires a non trivial 
mathematical procedure, and the mathematical effort to make from this side, to derive the 
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KS entropy, serves the useful purpose of proving that the KS entropy of a trajectory is a 
really wise way of converting into advantages the drawbacks of the trajectory instability. 



III. THE KS ENTROPY FROM A REDUCED FROBENIUS-PERRON 

EQUATION 

This Section is devoted to a rigorous discussion resting only on the theoretical tools 
described in Ref. |Tl[] for a genuine probability density aproach. According to Mackey [jl3|, 



if we rule out the possibility that the laws of physics are misrepresented by invertible dynamic 
prescriptions, there are only two possible sources of entropy increase. The first is the coarse 
graining discussed in Section II. The second is the adoption of reduced equation of motion. 



obtained by a trace over "irrelevant" degrees of freedom [|T3|. In fact here we study the 
Bernoulli shift map, 

Xt+i = 2xt, modi. (32) 

The Frobenius-Perron equation of this map is defined by 

p{x, t + l) = Ap{x, t) = ^ t) + P(^, t)]. (33) 

It is straigtforward to show that the Frobenius-Perron operator of Eq. (|33|) stems from the 
contraction over the variable y of the baker's mapping, acting in fact on the unit square 



of two-dimensional space (x,y) (see, for instance Ref. [|14[)- K is shown that the KS 
entropy of the baker's transformation is well defined and turns out to be the same as that 
of the Bernoulli shift map, namely hxs = ^^2. Intuitively, this suggests that the main 
role of coarse graining is that of making inactive the process of contraction, and with it 
the negative Lyapunov coeficient. This intuitive argument seems to be plausible and raises 
the interesting question of how to prove it with a rigorous approach. This is equivalent 
to deriving the Kolmogorov regime using a rigorous mathematical method rather than the 
heuristic arguments of Section II. We must observe again that this is made possible by the 
fact that the tracing has changed the originally invertible map into one that is not invertible. 
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To address this issue we follow the prescription of Ref. [|TT|. First of all, we express the 



distribution density at time t under the form given by Ref. [11| which reads: 



p{x,t) = l + 5^exp(-7,t)^[p(^-^)(l,0) -p(^-^)(0,0)]. (34) 
j=i J- 

Note that 7^- = jln2, Bj{x) are the Bernoulli polynomials pO[ and t) denotes the n-th 

order derivative of p{x, t) with respect to x. Hereby, we shall show how to derive from the 
previous one more tractable expression,which will be checked in appendix. 

In the case of an initial condition close to equilibrium, resulting from the sum of the 
equilibrium distribution and the first "excited" state, it is easy to prove that the entropy 
S{t) of Eq. (^ reaches exponentially in time the steady-state condition. This suggests 
that the Kolmogorov regime, where the entropy S{t) is expected to be a linear function of 
time, must imply an initial condition with infinitely many "excited" states. To deal with a 
condition of this kind it is convenient to express Eq. (|3^) in an equivalent form given by 



00 .+00 B ir) Hi,) 
p{x,t) = 1 + E / -^Hzooy-'p{u^){exp{-zu) - 1)^, (35) 

where z = exp[—t{ln2)] and p{uj) is related to the initial condition p{x, 0) by the Fourier 
transform 

/+00 (j^Qj 
p{uj)exp{—iujx) — . (36) 
-00 2ti 

The following equation 



00 



is known to generate Bernoulli polynomials. Using this Bernoulli polynomial generatrix, 
we arrive, after some algebra, at 

/ \ I ■ \-i \ exp(—iLu) — l duj 
p[x,t) = z \ exp{-iujzx)p{uj) — — -— . (38) 

j-00 exp[—iujz) — 1 271 

By expanding the denominator of Eq. (^Sj) into a Taylor series and using Eq. ( |5BD , we finally 
derive the fundamental expression 
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p{x, t) = z ^ [p{zx + zn, 0) — p{zx + zn + 1, 0)]. (39) 

n=0 

This important expression makes it possible for us to discuss analytically the entropy time 
evolution ensuing the preparation of an initially very sharp distribution. Let us consider in 
fact 

01 

p(x^O) = 7 -exp(—ax),0 < x < 1. (40) 

1 — exp[—a) 

For a — > oo this initial distribution becomes a very sharp distribution located at x = 0. By 
plugging this initial distribution density into Eq.(|39D we obtain 

exp(—axz) , 

p{x, t) = za '-. 41 

1 — exp[—az) 

It is evident that this simple analytical expression for the time evolution of the distribution 
density is exact, and corresponds to the time evolution dictated by the Frobenius- Perron 
operator of Eq. (|33|) . 

We are now in a position to discuss the central issue of this paper, namely, the time 
evolution of the Gibbs entropy of Eq.(|D, which, in the case here under study, reads 



S{t) = - p{x,t)ln[p{x,t)]dx, (42) 
with X now denoting the interval [0, 1]. By plugging Eq.(^OD within Eq.(|4^) we obtain 

OLZ 

S(t) = 1 — In(az) + In [1 — exp(—az)] — . (43) 

exp[az) — 1 

In the limiting case a ^ oo this exact prediction is approximated very well by 

S{t) = -ln{a) + {ln2)t. (44) 

It indicates that a sharp initial distribution makes the system evolve according to the KS 
entropy, with no regime of transition from mechanics to thermodynamics. The third regime 
of Ref. 0] is still present. It is straigtforward to show that the saturation time ts = lna/ln2 
resulting from Eq.(|43|) is the same as that of Eq. ([T3|) in the case V = 1. In fact using 
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Eq.(|T6]) and V" = 1 we obtain that Wmax/W{<d) = 1/U{0), where U{0) is the size of the 
initial distribution. The size of the initial distribution of Eg. (|40|) , for a — oo, becomes 
prportional to 1/a. Thus, Ina ~ ln{Wmax/W{0) in accordance with Eq. (|13[). 

This is an elegant result, involving a modest amount of algebra. However, it refers to 
an initial distribution located at x = 0. We want to prove that this is a general property, 
independent of where the initially sharp distribution is located, at the price, as we shall see, 
of a more complicated mathematical treatment. For this purpose we study the case where 
the distribution shape is the Lorentzian curve: 

r 



p{x,0) = A- 



(45) 



{x - xo)^ + r^' 

with xq being a generic point of the interval [0, 1] and x running in the same interval. Setting 
the normalization condition yields 

1 



A 



(46) 



arctan (^^^ + arctan 

We have to set again the condition that the initial distribution is very sharp. Thus we make 
the assumption F ^ 0, yielding A ^ 1/tt. We plug this approximated value of A into Eq. 
(p9|), thereby obtaining the following density time evolution 

1 1 



zT °° 

^ n=0 



_{zx + zn — xof + F^ {zx + zn — Xq + Vf + F^ 



(47) 



We are now in a position to study the entropy time evolution again. Plugging Eq.(^7D 
into (PI) we find 



Sit) 



p (x, t) In 



X 



z ^ 1 

TTi n / zx+zn—xij 



p (x, t) In 



X 



ttF 



dx — J p (x, t) In 

X 



E 

n=0 



1 



+ 1 ( 



zx+zn—XQ+l 

r 



dx 



^ zx+zn-XQ ^ _|_ ^ 



zx+zn—XQ+1 j _j_ 



dx. 



where [y\ denotes the integer part of y. To derive a more tractable expression we note that 
in the limiting case of F very small, the quantities [. . .] contributing this series are almost 
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zero except for n = — [x] + ^ = ^ in the first term, and for the possible contribution 
n = —\x\ — ^— ^ = — ^— ^ in the second term. The latter condition cannot be realized, 
since n is a positive integer. Thus, using only the first class of contributions, we get for the 
entropy S{t) the following approximate expression 



l n(l/^ + i: 

2/2+1 



■dy, 



(48) 



Sit) ^Inr + (ln2)t-ln7r- j 
which, in the limiting case |r — > oo becomes 

oo ,2 -.\ 

S{t) Rilnr + (ln2)t-ln7r- / — ^-^-^dy = InT + (ln2) t - Iutt - 7rln2 InT + (ln2) t. 

J + 1 



(49) 

As in the earlier case, the validity of the approximation yielding the linear dependence of 
S{t) on time, is broken at the time t ~ — InF/ ln2. In conclusion, the Kolmogorov condition 
is realized by very sharp initial distributions. Our derivation of this interesting property was 
done adhering to the recommendation of Ref. [|6|,[7|pA| of resting only on densities rather than 
on trajectories. 



IV. CONCLUDING REMARKS 

This paper shows that there exists a subtle difference between a Liouville density and 
a probability distribution. The Liouville distribution density of a chaotic map, which is at 
the same time invertible, becomes increasingly fragmented with time. If the initial distri- 
bution has a volume which is much smaller than the volume of the phase space, the highly 
fragmented distribution density at large times has a volume identical to the initial, but 
the impression afforded by a coarse-grained observation is that the initial volume increases 
with time till to become equal to that of the whole phase space. If we do the calculation 
of the time evolution of the Liouville density observing the motion of many trajectories 
with slightly different initial conditions, we are forced to adopt a coarse-graining procedure, 
dictated by the need itself of counting how many trajectories are found at a given time in 
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a given small region of the phase space. This has the effect of making the Gibbs entropy 
increase. If, on the contrary, the calculation genuinely rests on the motion of the Liouville 
density, thereby implying that a quantum-like formalism is adopted, the Gibbs entropy is 
constant. 

On the other hand, the KS entropy is a trajectory property and this, to first sight, might 
lead us to believe that, being a trajectory property, cannot be recovered from within an 
approach genuinely resting on the distribution density. The heuristic arguments used in 
Section II subtly rest on the trajectory properties and thus on the assumption that the two 
perspectives are equivalent in spite of the warnings of the authors of Refs. |]6|J^,pA|]. This is 
the reason why we judge the theoretical calculations of Section III to be of significant inter- 
est. These results have been obtained without having any direct recourse to the trajectory 



instability and only using the theoretical tools illustrated in Ref. , which in fact address 
the problem of the dynamics of map using the quantum mechanical language of eigenstate 
and eigenvalue. It has to be pointed out that to establish this rigorous connection be- 
tween the linear increase of the Gibbs entropy and the KS entropy we need to use infinitely 
many "excited" states, namely, a condition very far from equilibrium. The adoption of a 
"reduced" Liouville-like equation has been essential for the success of this enterprise. The 
Frobenius-Perron operator of the Bernoulli shift map is obtained from the Frobenius- Perron 
operator of the baker's transformation via contraction over the variable corresponding 
to the contraction process. As a consequence, room is only left for dilatation. This is the 
reason why the heuristic argument of Eq.(^ holds true with no restriction and the use of 
a method rigorously based on densities lead to the same result. After all, the adoption of 



the theoretical tools of Ref. as a rigorous way to evaluate the regression to equilibrium, 



must reflect in a way the trajectory instabilities behind the Pesin theorem of Eq.(|^). 

In the case where the action of the negative Lyapounov coefficient is quenched by a 
coarse-graining process, in addition to the saturation and to the Kolmogorov regime, also 
a short-time regime of transition to thermodynamics appears, so that, as found in Ref. 
1^ three distinct regimes can be detected, the regime of transition to thermodynamics, 
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the Kolmogorov regime, and the saturation regime. Here we show that the three regimes 
discussed by Latora and Baranger ^ are exhibited also in the case of a coarse graining 
produced by random fluctuations. 

In conclusion, this paper contributes to deepening our understanding of the connection 
between density and trajectory distribution. The density entropy exhibits a regime of in- 
crease linear in time with a rate equivalent to that of the trajectory entropy if the initial 
distribution is very sharp. It has to stressed that it cannot be infinitely sharp. This would 
make the distribution density useless, since an infinitely sharp initial distribution would man- 
ifest the lack of robustness pointed out by Driebe ||lT|. Thus, the connection is established 
using a genuine density. At the same time the accordance between the heuristic approach 
yielding the derivation of Eq.(^^ can be interpreted as a rigorous support of the assump- 



tions made by some some authors ||T5[ to derive the KS entropy from within a probability 
distribution approach. 

We want to remark that we are not aware of earlier work where the Lyapounov coefficient 
is derived analytically from a probability density approach with no use of heuristic arguments 
but that of Pattanayak and Brumer |]2T| which, however, seems to be limited to the study 
of the transition regime 



A problem open to future research concerns the role of coarse-graining. We have seen 
that in the case of strong chaos studied in this paper there is no essential difference be- 
tween the coarse graining resulting from the repartition of the phase space into cells and 
the coarse graining caused by fluctuations. In the case of dynamic systems like the weakly 



chaotic billiards studied by Zaslavsky |23,24|, which are easily proved to be statistically 



equivalent to the intermittent maps of Ref. [17|, the two different coarse-graining sources 



result in different physical effects at long times. On the other hand, it is expected ||2^ 
that the dynamic process of transition to Levy statistics is characterized by thermodynamic 



properties of non-extensive nature [|26[. The study of the time evolution of non-extensive 
entropy under the actions of the two different sources of coarse graining studied in this paper 
would an interesting program for future research work. 



APPENDIX 



The purpose of this Appendix is to check the main result of Section III. Our theoretical 



reference on this issues is given by the book of Ref . |TT| . We note, however, that Eqs. (ETf) 



and Eq. (|47|) are not directly derived from Eg . (|3^ , which is a theoretical finding of Ref. JTTl, 



but they are derived from Eq.(^), wich is the result of a further development of the theory 
of Ref. [|lT|. We feel therefore the need of proving that Eq. (|39|) fits the main requirement of 
keeping the norm unchanged and of being an exact solution of Frobenius-Perron equation 
of Eq. (|33|) . To double check our results, we shall prove also that Eqs. (|4l|) and Eq.(^) fit 
the same property. As a general remark about the content of this appendix we note that a 
function of the variable x, defined only within the finite interval [0, 1], admits a treatment 
based on its Fourier transform if it is thought of as being defined on the whole interval 
[—00,00] with vanishing value outside [0,1]. Similarly we can define the Fourier series of 
this function assuming it to be periodically repeated all over the real axis. We shall adopt 
this approach throughout the whole appendix. 

Let us check Eq.(^) first. We note that the argument of the density of Eq.(pUD can be 
arbitrary with the only condition that the variable x is in the interval [0,1]. Furthermore, 
since Eq . (p9D is derived from Eq.(^), it is enough for us to prove that Eq.(^) is properly 
normalized and is a solution of the Frobenius-Perron equation of Eq . (|33D . In conclusion, we 
have to check: 



-00 



First we check that this equation is norm conserving or: 



1 

p{x,t)dx = l. (A-2) 



To do so, we integrate Eq.( [A-l| with respect to the variable x from —00 to +00. Thus we 
obtain: 
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This means the expression 
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The integral over uo is by definition the Fourier transform of p{y, 0), yielding thereby 



(A-4) 



1 H 

p{x,t)dx= / p{y,0)dy = lyt, 

JO 



(A-5) 



due to the fact that the initial condition is assumed to be normalized. 

We want now to prove that the distribution density p{x, t) of Eq. ( |A-1|) is a solution of 
the Frobenius-Peron operator of Eq. (p3D , namely, that: 



p{x,t + l) 



(A-6) 



Remembering that z = 2 * and f = 2 * ^ we can write Eq.( |A-l| )as: 



z 



1 duj 



pix,t + l) = - I e-^"""/'p(cu)— — ^ . 



(A-7) 



Plugging Eq.( |A-l| ) into it, the r.h.s. of Eq. (|A-6|) becomes: 



P(|,^)+P(^,^) 
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and after a little algebra we get: 
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By decomposing the denominator as follows 



-iujzx/2 



+ 1 



dco 



- 1 



277 



(A-8) 



(A-9) 



20 



(A-10) 



and simplifying, we obtain 



p(|.«)+/'(^.*) 



(A-11) 



that coincide with Eq.( |A-7| ). 

To check the property p (x, t) ^ 1 for t ^ oo or z — > we use (|A-1|) and we write: 

e"*^ -Iduj 



r+oo 

P{x,t) Z I piu)- 



-OO g" 
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-iuj 2tt 



I — OO 
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p(cj) / e-*^^rfx^ = /o^ p(x)rfx = 1. 
JO 27r 



Now we shall test directly the Eq.(41) using Eq.(0). Plugging directly the initial distri- 
bution: 



p(x, 0) 



a 



1 - e-" 



-e-"^0 < X < 1 



into Eq.(l^) we obtain: 



i=o 



1 -e- 



j=0 



Using the Bernoulli polynomials generatrix [2C] we get 



(A-12) 



(A-13) 



p{x, t) = za 



1 -e- 



(A-14) 



that coincides with Eq. (|4l|) obtaned using the formula Eq. (|39D 

Finally let us to check the norm conservation of Eq.(^). Without any approximation, 
using the value of A of Eq . (^Bf ) , and a little algebra, we get: 



arctan (^^^ + arctan 
1 1 



arctan (^a) + arctan (^)] ■ En=o 



-1 



dx 



arctan _ arctan ( ^^+""+^-^'° )] . (A-15) 
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This yields: 



Jq p (x, t) dx = arctan (^^^ + arctan 



+00 
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— arctan 
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V r ) 
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Examining the expression we can note that only the terms with n = survive in the sum 
but that terms simplify with the external factor (the constant A) so finally 



p (x, t) dx = 1 Vt. 



(A-16) 



Checking that Eq.(47) fulfils the Frobenius- Perron operator involves some extended but 
straightoforward algebra. 
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Abstract 

We study the problem of entropy increase of the Bernoulli-shift map with- 
out recourse to the concept of trajectory and we discuss whether, and under 
which conditions if it does, the distribution density entropy coincides with the 

Kolmogorov- Sinai entropy, namely, with the trajectory entropy. 
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I. INTRODUCTION 



The problem of establishing a connection between the Kolmogorov-Sinai (KS) entropy 
[1,2] and the conventional entropy expressed in terms of probability density is an interesting 
problem that is attracting some attention in literature [3,4]. Early work on this subject 
goes back to the discussion of Goldstein and Penrose [5]: These authors, almost twenty 
years ago, established a connection between the KS entropy and a coarse-grained version 
of the distribution density entropy. The work of Ref. [5] is based on a formal and rigorous 
mathematical treatment which for this reason might have eluded the attention of physicists 
working on this subject [3,4]. Thus we restate the problem using intuitive arguments which 
also make it possible for us to account for the more recent literature on the subject. In fact, 
our heuristic treatment will allow us to relate the results of the more recent work of Latora 
and Baranger [4] to the earlier work of Zurek and Paz [3]. 

In addition to revisiting the problem of how to make the KS entropy emerge from a 
nonequilibrium dynamic picture [5] , we shall touch also the intriguing problem of whether 
a thermodynamic perspective has to rest on the adoption of trajectories, as implied by the 
concept itself of KS entropy, or on the use of probability densities, advocated with strong 
arguments by Petrosky and Prigogine [6,7]. It is convenient to stress that the KS entropy 
[1,2] is a property of a single trajectory. The phase space is divided into cells, each cell 
being assigned a given label uj^.- Then we define a sequence of symbols by means of a single 
trajectory: The sequence is determined assigning to any time step the label of the cell where 
the trajectory lies at that time step. The trajectory is supposed to be large enough as to 
yield reliable values for the probabilities determined through the numerical frequencies. This 
means that we fix a window of size N , and we move this window along the sequence. For 
any window position a string of symbols ojq, cji, . . . ijOn-i is determined. Moving the window 
of fixed size N along the infinite sequence generated by the trajectory we have to evaluate 
how many times the same string of symbols appears, thereby leading us to determine the 
probability p{ujq,uji, . . .uj^-i)- The KS entropy is then defined by 
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hKs = lim H{N)/N, (1) 

W— f oo 

where H{N) is the conventional Shannon entropy of the window of size N defined by 

a;o„c<Ji...c<Jjv-i 

It is evident therefore that the KS entropy rests on trajectories, and, more specifically, it 
implies the adoption of only one trajectory of virtually infinite length. The KS entropy is 
very attractive because its value turns out to be independent of the repartition into cells 
of the phase space, due to the crucial role of the so called generating partitions [8]. In the 
specific case where a natural invariant distribution exists, it is shown [9] that 

fiKS = Ylj dxpeg{x)Xi{x) (3) 

i 

with Xi{x) > O.Note that x denotes the coordinate of a multidimensional phase space, 
Peg(x) is the natural invariant distribution and Xi{x) is a local Lyapounov coefficient, with 
i = l,d, d being the dimension of the system under study. From Eq.(3) we see that, as 
earlier pointed out, the KS entropy is independent of the repartition into cells. The original 
definition of Eq.(l), with N thought of as time, means that the KS entropy, as a property 
of a single trajectory, is the rate of entropy increase per unit of time. However, since the 
single trajectory under examination is infinitely long, and explores in time all the phase 
space available, the KS entropy can also be expressed in the form of an average over the 
equilibrium distribution density, without any prejudice for the single trajectory nature of 
this "thermodynamic" property. 

According to Petrosky and Prigogine [6,7], on the contrary, the connection between 
dynamics and thermodynamics implies the use of the Liouville equation 

d 

—p{^,t) = -iLp{^,t), (4) 

where L denotes both the classical and the quantum Liouville operator, and p(x, t) is the 
nonequilibrium distribution density. The reason for this choice is that the analysis of the 
Liouville operator, through the "rigged Hilbert" space, allows the appearance of complex 
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eigenvalues which correspond to irreversibility, and to the collapse of trajectories as well. 
This is the reason why distribution densities are judged to be more fundamental than tra- 
jectories. 

In this paper we limit our analysis to the special case where dynamics are generated by 
maps rather than by Hamiltonians. We do not address the difficult issue of discussing the 
thermodynamic limit N ^ oc which is the subject of very interesting recent discussions 
[7,10], and where, according to Lebowitz [10], ergodicity and mixing are neither necessary 
nor sufficient to guarantee the connection between dynamics and thermodynamics. We 
consider the case of low-dimension chaos, where probability emerges as a consequence of 
sensitivity to initial conditions [7]. Even in this case, however, according to the perspective 
established by Petrosky and Prigogine [6,7], probability densities are more fundamental than 
trajectories. The readers interested in knowing more about this perspective, entirely based 
on probability density, should consult the illuminating work of Driebe [11]. In this case the 
counterpart of Eq.(4) becomes 

p(x,t + l) = Ap(x,t), (5) 

where A is referred to as Frobenius-Perron operator. Of course, the operator L of Eq.(4) 
has to be identified with i{A — 1). 

According to the traditional wisdom, the Frobenius-Perron operator is expected to make 
the distribution densities evolve in the same way as that resulting from the time evolution 
of a set of trajectories with initial conditions determined by the initial distribution density 
[ll]:The known cases of discrepancy between the two pictures are judged to be more apparent 
than real [12]. Nevertheless, even in the case of invertible maps, the birth of irreversibility 
can be studied using the same perspective as that adopted for Hamiltonian systems, with 
Eq.(4) replaced by Eq.(5), and so using again probability densities rather than trajectories. 

However, we attempt at digging out the KS entropy from Eq.(5), and this purpose forces 
us to formulate a conjecture on how to relate entropy to p(x,t). A plausible choice seems 
to be 
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S(t) = -[ p(x,t)ln[p(x,t)]c?x. (6) 
^x 

We share the view of Goldstein and Penrose [5] who consider the KS entropy to be a 
nonequilibrium entropy. In other words, we may hope to derive the KS entropy from the 
time derivative of S{t) of Eq.(6). As Goldstein and Penrose do [5], to realize that purpose we 
have to address a delicate problem: In the case of invertible maps, S{t) is time independent 
[13], thereby implying a vanishing KS entropy. Yet, the baker's transformation, which is a 
well known example of invertible map, thereby yielding a time independent S{t), is shown 
[14] to yield a KS entropy equal to ln2, a fact suggesting a steady condition of entropy 
increase. We plan to discuss all this with the joint use of heuristic arguments and of the 
rigorous theoretical tools of Ref. [11]. 

The present paper uses as a paradygm of invertible map the two-dimensional baker's 
transformation, depending on two coordinates, x and y, the former corresponding to dilata- 
tion and the latter to contraction. Using this prototype for invertible dynamics, we aim at 
proving that the adoption of the distribution density in the case of invertible chaotic maps 
would lead to an increasing process of fragmentation, depending not only, as the KS entropy 
does, on the positive Lyapounov coefficient, but also on the negative one. The adoption of a 
coarse graining has the effect of quenching the action of the negative Lyapunov coefficient, 
thereby allowing the KS entropy to show up. Then, to go beyond these heuristic arguments 
we make a trace on the variable y, namely, on the process responsible for contraction, and 
we focus our attention on the contracted dynamics. This is equivalent to that produced by 
the Bernoulli shift map. Here room is only left for dilatation and the problem can be solved 
with a rigorous mathematical method, without using trajectories. 

The outline of the paper is as follows. In Section II we shall illustrate our heuristic 
picture. In Section III we shall address the problem by means of a rigorous treatment 
resting on the theoretical tools provided by Driebe [11]. In Section IV we shall draw some 
conclusions. Some delicate mathematical problems behind the theoretical calculations of 
Section III are detailed in Appendix. 
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II. HEURISTIC ARGUMENTS 



Note that the cases studied by Latora and Baranger [4] are two-dimensional, and our 
discussion here refers to a two-dimensional case, too. We have in mind the backer's trans- 
formation and X = (x, y). We denote by W{t) the number of cells occupied at a given time 
t. Note that W{0) < Wmax, where the symbol Wmax denotes the total number of cells into 
which we have divided the phase space X. Our heuristic approach is based on the following 
assumptions. 

(i) At the initial time only W{0) cells are occupied. 

(ii) At all times the trajectories are equally distributed over the set of occupied cells. 
This means 

S{t) = lnW{t). (7) 

(iii) We denote by A the positive Lyapounov coefficient, and we set 

W{t) = W{0)exp{Xt). (8) 

All these three assumptions have been borrowed from the recent work of Ref. [15]. The 
joint use of all them yields 

S{t) = Xt-lnW{0), (9) 

which corresponds to the Kolmogorov thermodynamical regime. Note that the positive 
Lyapounov coefficient in the case of the baker's transformation is shown [14] to be: 

A = ln2. (10) 

Note also that according to the arguments of Section I, the connection with the KS entropy 
is established through the time derivative of S{t). Thus, we conclude that 

(IS 

— = X = ln2 = hKs, (11) 

which corresponds to deriving the KS entropy from the distribution density picture. 
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This Kolmogorov regime is not infinitely extended. It has an upper bound, given by 
the fact that when equiUbrium is reached, even in the merely sense of a coarse-grained 
equilibrium, then the entropy stops increasing. An estimate of this time is obviously given 
by the solution of the following equation 

lnWma. = Xt-lnW{0), (12) 

which yields the following saturation time 

Furthermore a lower bound of validity exists, which will be easily estimated with very 
simple arguments. If the initial distribution includes a large number of cells and the size of 
this distribution along the coordinate y is L, and the size of the cells is e with e < L,, then 
it is evident that, in spite of the coarse graining the total number of cells occupied remains 
the same for a while. This time is easily estimated using the equation 

Lexp{-\t) = e, (14) 

which in fact defines the time at which the distribution volume, and consequently,the system 
entropy starts increasing. This time is denoted by the symbol and reads 

to = \ln (^) . (15) 

We denote by U (t) the volume of the distribution density at time t and by V the volume 
of the phase space, thereby implying that U{t) < V. We note that 

w(oj " [7(0) ' ^ ' 

where V is the total volume of the phase space and U{0) is the initial volume of the distri- 
bution density. Thus the Kolmogorov regime shows up in the following time interval 

to = \ln [!-)<t< is = \ln . (17) 



The time duration of the regime of validity of the Kolmogorov regime can be made infinitely 
extended by making the cell size infinitely small. This means that the confiict between the 
KS entropy prescription and the time independence of S{t) can be bypassed by focusing our 
attention on the intermediate region, whose time duration tends to infinity with e — > 0. We 
note that a choice can be made such that V/U{0) = (L/e)^, with x > 1- This means the 
time duration of the Kolmogorov regime can be made x times larger than the time duration 
of the transition regime. For e — > both time durations become infinite, thereby showing 
that a Kolmogorov regime of infinite time duration can be obtained at the price, however, 
of waiting an infinitely long time for the entropy to increase. The infinite waiting time 
before the regime of entropy increase fits the observation [13,12] that the Gibbs entropy of 
an invertible map is constant. The linear entropy increase showing up "after this infinite 
waiting time" allows the emergence of the KS entropy from within the probability density 
perspective. 

This kind of coarse graining might be criticized as corresponding to arbitrary choices of 
the observer. It is interesting to remark that there exists another interesting form of coarse 
graining, produced by weak stochastic forces. Both in the case where this stochastic forces 
mimic the interaction with the environment [3] or in the case where it happens to be an 
expression of spontaneous fluctuations [16] this kind of coarse graining can be regarded as 
being produced by nature. Here we limit ourselves to remarking that according to Zurek 
and Paz [3] these stochastic forces contribute a fluctuation-dissipation process mimicking 
the interaction between the system of interest and the environment. These authors studied 
the inverted stochastic oscillator 



where the friction 7 and the stochastic force f{t) are related to one another by the standard 
fluctuation-dissipation relation 



(fx 



(18) 



< ff{t) >= 27 < i—f >e, S{t) = 2DS{t). 



(19) 
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It is interesting to remark that the proper formulation of the second principle implies that 
the entropy of a system can only increase or remain constant under the condition of no 
energy exchange between the system and its environment. In the case of Eq.(19) the energy 
exchange between system and environment is negligible for any observation made in the 
time scale 

t<<l/7. (20) 

To ensure that the system entropy increase to take place with no energy exchange between 
system and its environment Zurek and Paz [3] set the condition of Eq.(20) and this, in turn, 
allows them to neglect the friction term in Eq.(18). Then, these authors adopted the modes 

u = ^ + Xx (21) 

and 

«,.f + Ax, (22) 
which make it possible for them to split Eq.(18) into 

^ = Xu{t) + fit) (23) 

and 

^ = -Xw{t) + f{t). (24) 

Let us imagine the initial distribution density as a rectangle of size Au;(0) along the 
direction w and Au{0) along the direction u. We keep denoting by U{t) the distribution 
volume at a given time t. Thus the volume of the initial distribution is 

U{0) = Au{0)Aw{0). (25) 

In the absence of the stochastic force f{t), Eqs.(23) and Eqs.(23) result in an exponential 
increase and an exponential decrease, with the same rate A, respectively. Consequently, the 
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Liouville theorem U{t) = U{0) is fulfiled. In the presence of stochastic force, we work as 
follows. In the former equation, with u increasing beyond any limit, the weak stochastic 
force f{t) can be neglected. This is not the case with the latter equation. In fact, w is a 
contracting variable in the absence of the stochastic force. In the presence of the stochastic 
force the minimum size of the distribution along w is given by 

< >li'= {D/X)''\ (26) 
This minimum size is reached in a time determined by the solution of the following equation 

^w{Q)exp{-Xt) = {D/Xfl'^ (27) 

yielding 

1 f xV^ 

to = jln f -J Aw{0). (28) 

Due to the fact that deterministic chaos is simulated by Zurek and Paz [3] by means of an 
inverted parabola, these authors did not consider the entropy saturation effects. However, 
it is straigthforward to evaluate the saturation effect with heuristic arguments concerning 
the case where the total volume of the phase space has the finite value V. From the time 
t = to on, the distribution volume U(t) increases exponentially in time with the following 
expression 

U{t) = At(j(0)A«(0)e2;p(At) = {D / Xf^ /:^u{tD)exp{\t). (29) 
Thus, the saturation time is now given by 

V 1 

(30) 



ts = jln 



Au{0)Aw{0) 

Using Eq.(25) we can write this saturation time as 



ts = \ln 



V 



(31) 



which coincides with Eqs.(17) and (13). 
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In conclusion, it seems that the emergence of a Kolmogorov regime is made possible 
by the existence of a form of coarse graining, and that it is independent of whether the 
coarse graining is realized by the division into cells or by a weak stochastic force. This 
property seems to make less important the discussion of whether the stochastic force is 
of environmental origin or rests on some kind of extension of the current physical laws. 
However, we have to point out that the situation significantly changes, if we move from a 
strongly to a weakly chaotic classical system. As a relevant example, let us refer ourselves 
to the work of Ref. [17]. The authors of this work study the asymptotic time limit of a 
diffusion process generated by using an intermittent map as a dynamic generator of diffusion. 
If these dynamics are perturbed by a white noise, a transition is provoked, at long times, 
from anomalous to normal diffusion. When the only source of random behavior is given by 
the sporadic randomness of the intermittent map [18], the long-time limit is characterized 
by Levy statistics, a physical condition in a striking conflict with the condition of Gaussian 
statistics produced by the action of fluctuations [17]. Here we limit our attention to the 
case of strong chaos where the two distinct sources of coarse graining produce equivalent 
effects. It might be of some interest for the reader to compare the coarse-graining approach 
of this section to the more formal method recently adopted by Fox [19] to deal with the 
same problem. 

It is interesting to stress that to make the regime of validity of the Kolmogorov regime as 
extended as possible we must make the ratio V/U{0) as large as possible (virtually infinite). 
This means that we have to choose an initial distribution density so sharp as to become 
apparently equivalent to a single trajectory. This seems to be an attractive way of explaining 
why in this condition the KS entropy is recovered, since, as stressed in Section I, the KS 
entropy is a single trajectory property. However, in accordance with the authors of Refs. 
[6,7,11] we must admit that there exists a deep difference between a trajectory and a very 
sharp distribution. The latter is stable and robust, while the former is not. In Section III 
we shall show that the rigorous derivation of the Kolmogorov regime requires a non trivial 
mathematical procedure, and the mathematical effort to make from this side, to derive the 
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KS entropy, serves the useful purpose of proving that the KS entropy of a trajectory is a 
really wise way of converting into advantages the drawbacks of the trajectory instability. 

III. THE KS ENTROPY FROM A REDUCED FROBENIUS-PERRON 

EQUATION 

This Section is devoted to a rigorous discussion resting only on the theoretical tools 
described in Ref. [11] for a genuine probability density aproach. According to Mackey [13], 
if we rule out the possibility that the laws of physics are misrepresented by invertible dynamic 
prescriptions, there are only two possible sources of entropy increase. The first is the coarse 
graining discussed in Section II. The second is the adoption of reduced equation of motion, 
obtained by a trace over "irrelevant" degrees of freedom [13]. In fact here we study the 
Bernoulli shift map, 

= 2xt,modl. (32) 

The Frobenius-Perron equation of this map is defined by [11] 

p{x, t + l) = Ap{x, t) = ^[p{^, t) + p{^,t)]. (33) 

It is straigtforward to show that the Frobenius-Perron operator of Eq.(33) stems from the 
contraction over the variable y of the baker's mapping, acting in fact on the unit square 
of two-dimensional space (x,y) (see, for instance Ref. [14]). It is shown [14] that the KS 
entropy of the baker's transformation is well defined and turns out to be the same as that 
of the Bernoulli shift map, namely Hks = ^^^2. Intuitively, this suggests that the main 
role of coarse graining is that of making inactive the process of contraction, and with it 
the negative Lyapunov coeficient. This intuitive argument seems to be plausible and raises 
the interesting question of how to prove it with a rigorous approach. This is equivalent 
to deriving the Kolmogorov regime using a rigorous mathematical method rather than the 
heuristic arguments of Section II. We must observe again that this is made possible by the 
fact that the tracing has changed the originally invertible map into one that is not invertible. 
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To address this issue we follow the prescription of Ref. [11]. First of all, we express the 
distribution density at time t under the form given by Ref. [11] which reads: 

p{x,t) = l + j:exp{-j,t)^[p(^-'\l,0)-p^^-'\0,0)]. (34) 
j=i J- 

Note that 7j = jln2, Bj{x) are the Bernoulli polynomials [20] and p(")(a;,t) denotes the n-th 
order derivative of p[x, t) with respect to x. Hereby, we shall show how to derive from the 
previous one more tractable expression, which will be checked in appendix. 

In the case of an initial condition close to equilibrium, resulting from the sum of the 
equilibrium distribution and the first "excited" state, it is easy to prove that the entropy 
S(t) of Eq. (6) reaches exponentially in time the steady-state condition. This suggests 
that the Kolmogorov regime, where the entropy S{t) is expected to be a linear function of 
time, must imply an initial condition with infinitely many "excited" states. To deal with a 
condition of this kind it is convenient to express Eq.(34) in an equivalent form given by 



p{x,t) = 1 + E / ^{-izu:y-'p{u,){exp{-iu,) - 1) — , (35) 

where z = exp[—t{ln2)] and p{uj) is related to the initial condition p{x, 0) by the Fourier 
transform 

/' + 00 
p{uj)exp{—iujx) — . (36) 
-oo ZTT 

The following equation 



oo 



Bjjx) ^, _ , expjzx) 
fy, j\ ' -'exp{z)-V ^^^^ 

is known [20] to generate Bernoulli polynomials. Using this Bernoulli polynomial generatrix, 
we arrive, after some algebra, at 

/ X f~^°° / . N-./ N exp(—iu}) — l duj 

plx.t) = z exp(—iu)zx)p(u}) ; r . (38) 

' ^ 7-00 ^ ^ exp{-icoz) -12tt ^ ' 

By expanding the denominator of Eq.(38) into a Taylor series and using Eq.(36), we finally 
derive the fundamental expression 
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p{x, t) = z '^[p{zx + zn, 0) — p{zx + + 1, 0)]. (39) 

This important expression makes it possible for us to discuss analytically the entropy time 
evolution ensuing the preparation of an initially very sharp distribution. Let us consider in 
fact 

o. 

plx, 0) = -. -exp(—ax), < x < 1. (40) 

1 — exp{—a) 

For q; — > oo this initial distribution becomes a very sharp distribution located at a: = 0. By 
plugging this initial distribution density into Eq.(39) we obtain 

exp( — nxz) 

p{x,t)=za ^. 41 

1 — exp{—az) 

It is evident that this simple analytical expression for the time evolution of the distribution 
density is exact, and corresponds to the time evolution dictated by the Frobenius-Perron 
operator of Eq.(33). 

We are now in a position to discuss the central issue of this paper, namely, the time 
evolution of the Gibbs entropy of Eq.(6), which, in the case here under study, reads 

S(t) = -[ p(x,t)ln[p(x,t)]dx, (42) 
Jx 

with X now denoting the interval [0, 1]. By plugging Eq.(40) within Eq.(42) we obtain 

(yz 

S(t) = 1 - Iniaz) + In [1 - expi-az)] — ^ . (43) 

exp[az) — 1 

In the limiting case a — > cxd this exact prediction is approximated very well by 

S{t) = -ln{a) + {ln2)t. (44) 

It indicates that a sharp initial distribution makes the system evolve according to the KS 
entropy, with no regime of transition from mechanics to thermodynamics. The third regime 
of Ref. [4] is still present. It is straigtforward to show that the saturation time ts = lna/ln2 
resulting from Eq.(43) is the same as that of Eq.(13) in the case V = 1. In fact using 
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Eq.(16) and y = 1 we obtain that Wmax/W{0) = 1/U{0), where U{0) is the size of the 
initial distribution. The size of the initial distribution of Eq.(40), for a — > oo, becomes 
prportional to 1/a. Thus, Ina ^ ln{Wmax/W{0) in accordance with Eq. (13). 

This is an elegant result, involving a modest amount of algebra. However, it refers to 
an initial distribution located at a; = 0. We want to prove that this is a general property, 
independent of where the initially sharp distribution is located, at the price, as we shall see, 
of a more complicated mathematical treatment. For this purpose we study the case where 
the distribution shape is the Lorentzian curve: 

r 



p{x,0) = A- 



(45) 



{x — xo)^ + ' 

with xo being a generic point of the interval [0, 1] and x running in the same interval. Setting 
the normalization condition yields 

1 



A 



(46) 



arctan j + arctan (^-^) 
We have to set again the condition that the initial distribution is very sharp. Thus we make 
the assumption F ^ 0, yielding A ^ I/tt. We plug this approximated value of A into Eq. 
(39), thereby obtaining the following density time evolution 

1 1 



zT °° 

p{x,t) = — Y, 



{zx + zn — Xof + F^ (zx -\- zn — xq -\- 1)^ + F^ 



(47) 



We are now in a position to study the entropy time evolution again. Plugging Eq.(47) 
into (42) we find 



S{t) = - j p{x,t) 



In 



^0 (^ zx+zn-xo y ^ I ^ 

1 1 



J p{x,t) 



In 



X 



ttF, 



dx 



j p{x,t) 



In 



X 



zx+zn—XQ+l 

r 



) +1. 



dx 



^ zx+zn-xn ^ _|_ ^ zx+zn-xn+l ^ _|_ 



where [y] denotes the integer part of y. To derive a more tractable expression we note that 
in the limiting case of F very small, the quantities [. . .] contributing this series are almost 
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zero except for n = — [x] + = [^] the first term, and for the possible contribution 
n = —[x] — [^^^] = — [-^-^^ in the second term. The latter condition cannot be realized, 
since n is a positive integer. Thus, using only the first class of contributions, we get for the 
entropy S{t) the following approximate expression 

S (t) ^\nr + (In 2) i - In TT - /' i^^-^^-^dy , (48) 

J V + 1 



which, in the limiting case ^ ^ oo becomes 

S(t) lnr + (In2)t-ln7r- / " \ ^ = In T + (In 2) t - Iutt - tt In 2 ?a In T + (In 2) t. 

J + 1 



f Injy^ + 1) 

(49) 



As in the earlier case, the validity of the approximation yielding the linear dependence of 
S{t) on time, is broken at the time t ~ — InF/ In 2. In conclusion, the Kolmogorov condition 
is realized by very sharp initial distributions. Our derivation of this interesting property was 
done adhering to the recommendation of Ref. [6,7,11] of resting only on densities rather than 
on trajectories. 



IV. CONCLUDING REMARKS 

This paper shows that there exists a subtle difference between a Liouville density and 
a probability distribution. The Liouville distribution density of a chaotic map, which is at 
the same time invertible, becomes increasingly fragmented with time. If the initial distri- 
bution has a volume which is much smaller than the volume of the phase space, the highly 
fragmented distribution density at large times has a volume identical to the initial, but 
the impression afforded by a coarse-grained observation is that the initial volume increases 
with time till to become equal to that of the whole phase space. If we do the calculation 
of the time evolution of the Liouville density observing the motion of many trajectories 
with slightly different initial conditions, we are forced to adopt a coarse-graining procedure, 
dictated by the need itself of counting how many trajectories are found at a given time in 
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a given small region of the phase space. This has the effect of making the Gibbs entropy 
increase. If, on the contrary, the calculation genuinely rests on the motion of the Liouville 
density, thereby implying that a quantum-like formalism is adopted, the Gibbs entropy is 
constant. 

On the other hand, the KS entropy is a trajectory property and this, to first sight, might 
lead us to believe that, being a trajectory property, cannot be recovered from within an 
approach genuinely resting on the distribution density. The heuristic arguments used in 
Section II subtly rest on the trajectory properties and thus on the assumption that the two 
perspectives are equivalent in spite of the warnings of the authors of Refs. [6,7,11]. This is 
the reason why we judge the theoretical calculations of Section III to be of significant inter- 
est. These results have been obtained without having any direct recourse to the trajectory 
instability and only using the theoretical tools illustrated in Ref. [11], which in fact address 
the problem of the dynamics of map using the quantum mechanical language of eigenstate 
and eigenvalue. It has to be pointed out that to establish this rigorous connection be- 
tween the linear increase of the Gibbs entropy and the KS entropy we need to use infinitely 
many "excited" states, namely, a condition very far from equilibrium. The adoption of a 
"reduced" Liouville-like equation has been essential for the success of this enterprise. The 
Frobenius-Perron operator of the Bernoulli shift map is obtained from the Frobenius-Perron 
operator of the baker's transformation via contraction over the variable y, corresponding 
to the contraction process. As a consequence, room is only left for dilatation. This is the 
reason why the heuristic argument of Eq.(8) holds true with no restriction and the use of 
a method rigorously based on densities lead to the same result. After all, the adoption of 
the theoretical tools of Ref. [11] as a rigorous way to evaluate the regression to equilibrium, 
must reflect in a way the trajectory instabilities behind the Pesin theorem of Eq.(3). 

In the case where the action of the negative Lyapounov coefficient is quenched by a 
coarse-graining process, in addition to the saturation and to the Kolmogorov regime, also 
a short-time regime of transition to thermodynamics appears, so that, as found in Ref. 
[4] three distinct regimes can be detected, the regime of transition to thermodynamics, 
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the Kolmogorov regime, and the saturation regime. Here we show that the three regimes 
discussed by Latora and Baranger [4] are exhibited also in the case of a coarse graining 
produced by random fluctuations. 

In conclusion, this paper contributes to deepening our understanding of the connection 
between density and trajectory distribution. The density entropy exhibits a regime of in- 
crease linear in time with a rate equivalent to that of the trajectory entropy if the initial 
distribution is very sharp. It has to stressed that it cannot be infinitely sharp. This would 
make the distribution density useless, since an infinitely sharp initial distribution would man- 
ifest the lack of robustness pointed out by Driebe [11]. Thus, the connection is established 
using a genuine density. At the same time the accordance between the heuristic approach 
yielding the derivation of Eq. (44) can be interpreted as a rigorous support of the assump- 
tions made by some some authors [15] to derive the KS entropy from within a probability 
distribution approach. 

We want to remark that we are not aware of earlier work where the Lyapounov coefficient 
is derived analytically from a probability density approach with no use of heuristic arguments 
but that of Pattanayak and Brumer [21] which, however, seems to be limited to the study 
of the transition regime [22]. 

A problem open to future research concerns the role of coarse-graining. We have seen 
that in the case of strong chaos studied in this paper there is no essential difference be- 
tween the coarse graining resulting from the repartition of the phase space into cells and 
the coarse graining caused by fiuctuations. In the case of dynamic systems like the weakly 
chaotic billiards studied by Zaslavsky [23,24], which are easily proved to be statistically 
equivalent to the intermittent maps of Ref. [17], the two different coarse-graining sources 
result in different physical effects at long times. On the other hand, it is expected [25] 
that the dynamic process of transition to Levy statistics is characterized by thermodynamic 
properties of non-extensive nature [26]. The study of the time evolution of non-extensive 
entropy under the actions of the two different sources of coarse graining studied in this paper 
would an interesting program for future research work. 
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APPENDIX 



The purpose of this Appendix is to check the main result of Section III. Our theoretical 
reference on this issues is given by the book of Ref . [11]. We note, however, that Eqs. (41) 
and Eq.(47) are not directly derived from Eq.(34), which is a theoretical finding of Ref. [11], 
but they are derived from Eq.(39), wich is the result of a further development of the theory 
of Ref. [11]. We feel therefore the need of proving that Eq.(39) fits the main requirement of 
keeping the norm unchanged and of being an exact solution of Frobenius-Perron equation 
of Eq.(33). To double check our results, we shall prove also that Eqs. (41) and Eq.(47) fit 
the same property. As a general remark about the content of this appendix we note that a 
function of the variable x, defined only within the finite interval [0, 1], admits a treatment 
based on its Fourier transform if it is thought of as being defined on the whole interval 
[—00,00] with vanishing value outside [0, 1]. Similarly we can define the Fourier series of 
this function assuming it to be periodically repeated all over the real axis. We shall adopt 
this approach throughout the whole appendix. 

Let us check Eq.(39) first. We note that the argument of the density of Eq.(39) can be 
arbitrary with the only condition that the variable x is in the interval [0,1]. Furthermore, 
since Eq.(39) is derived from Eq.(38), it is enough for us to prove that Eq.(38) is properly 
normalized and is a solution of the Frobenius-Perron equation of Eq.(33). In conclusion, we 
have to check: 



To do so, we integrate Eq.(A-l with respect to the variable x from —00 to +00. Thus we 




(A-1) 



First we check that this equation is norm conserving or: 




(A-2) 



obtain: 
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Jo J-oo e 



1 duj 



oo —lUJ 



- 1 27r 

1 ^ , , e-^"^ - 1 duj 
—pyuj) — : . 



dx 



(A-3) 



This means the expression 



The integral over uj is by definition the Fourier transform of p{y, 0), yielding thereby 



(A-4) 



/ p{x,t)dx= / p{y,0)dy = lyt, 
Jo Jo 



(A-5) 



due to the fact that the initial condition is assumed to be normalized. 

We want now to prove that the distribution density p{x, t) of Eq. (A-1) is a solution of 
the Frobenius-Peron operator of Eq.(33), namely, that: 



p{x,t + l) 



(A-6) 



Remembering that z = 2 ^ and | = 2 * ^ we can write Eq.(A-l)as: 



p{x, t + 1 



-oo , p- 



1 du) 



Plugging Eq.(A-l) into it, the r.h.s. of Eq.(A-6) becomes: 



(A-7) 



hoo . , p- 



1 du 



-luiz _ 1 27r 
and after a little algebra we get: 



' e-'^^ - 1 27r 



z 



-iujzxl2 



2 J — oo 

By decomposing the denominator as follows 



p{u) 



\e-'^ - 1] [e-^"^^/2 + l] 



27r' 



(A-8) 



(A-9) 
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and simplifying, we obtain 



that coincide with Eq.(A-7). 

To check the property p (x, t) — > 1 for t — > 00 or 2; ^ we use (A-1) and we write: 

hoo g-^^ -Idu) 



p+oo I 

p{x,t) z / p(a;)- 

J —00 



icoz 2tt 

x = 1. 



/+°° p-*'^ _ 1 fli.) r+00 rl . (j, J 

Piuj f—^p = / pH / dxf^ = p{x)d. 

-00 — Za; ZTT ^-00 ^0 ZTT 

Now we shall test directly the Eq.(41) using Eq.(34). Plugging directly the initial distri- 
bution: 

p(x, 0) = ^ ^^_^ e~"^, < X < 1 (A-12) 

into Eq.(34) we obtain: 

p{x,t) = f:e-^^*^[p(^-i)(l,0) -p(^-^)(0,0)] 



j=0 



J! 



Using the Bernoulli polynomials generatrix [20] we get 

p{x,t) = zar^—^. (A-14) 

that coincides with Eq.(41) obtaned using the formula Eq.(39) 

Finally let us to check the norm conservation of Eq.(47). Without any approximation, 
using the value of A of Eq.(46), and a little algebra, we get: 

Jq p {x, t) dx = l^arctan + arctan (^-7^)] 

• /o En^O [(zx+zn-xof+r^ ~ (zx+zn-xo+lf +r'^] 

= [arctan (fi) + arctan (^)]~^ • [arctan (m+m^) _ arctan (| W2+i-^o ^]^=^ _ (^-15) 
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This yields: 

Jq p {x, t) dx = l^arctan {^^^ + arctan (^-7^)] 



-1 



E+00 
71 = 



arctan - arctan (i±2i^±i^) _ arctan (^^) + arctan 



Examining the expression we can note that only the terms with n = survive in the sum 
but that terms simplify with the external factor (the constant ^4) so finally 

[\(x,t) dx = lyt. (A-16) 
^0 

Checking that Eq.(47) fulfils the Frobenius-Perron operator involves some extended but 
straightoforward algebra. 
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